Model

The model used for SynBot was GPT35-pss. It was made using Azure OpenAI and LangChain.

from langchain_openai.chat_models.azure import AzureChatOpenAI
from openai import AzureOpenAI

llm = AzureChatOpenAI(
    openai_api_key="<OPENAI_API_KEY>",
    deployment_name="<deployment name>",
    model_name="<model name>",
    azure_endpoint="<AZURE_ENDPOINT>",
    openai_api_version="<API_VERSION>",
    temperature=0.5,
    streaming=True
)

The LLM was used for a number of tasks including simplifying the prompt into sub-tasks, Retrieval Augmented Generation and chat completion through the ReAct agent.